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In this paper we investigate the dependence structure for PARMA mod- 
els (i.e. ARMA models with periodic coefficients) with symmetric a— stable 
innovations. In this case the covariance function is not defined and therefore 
other measures of dependence have to be used. After obtaining the form 
of the bounded solution of the PARMA system with symmetric a-stable 
innovations, we study the codifference and the covariation - the most pop- 
ular measures of dependence defined for symmetric stable time series. We 
show that both considered measures are periodic. Moreover we determine 
the cases when the codifference and the covariation are asymptotically pro- 
portional with the coefficient of proportionality equal to a. 

PACS: 89.65.Gh, 05.45.Tp, 02.50.Cw 

1. Introduction 

Conventional time series analysis is heavily dependent on the assumption 
of stationarity. But this assumption is unsatisfactory for modelling many 
real-life phenomena that exhibit seasonal behaviour. Seasonal variations in 
the mean of time series data can be easily removed by a variety of methods, 
but when the variance varies with the season, the use of periodic time se- 
ries models is suggested. In order to model periodicity in autocorrelations, 
a class of Periodic Autoregressive Moving Average (PARMA) models was 
introduced. The PARMA(p, q) system is given by: 

p 9-1 
X n ~Y^ bj(ri)X n -j = ai(n)£ n -i, (1) 

j=l i=0 

where n G Z and the coefficients {6j(n)Vj =1 and {ai(n)}f~Q are nonzero 
sequences periodic in n with the same period T while the innovations {£ n } 
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are independent Gaussian random variables. For such PARMA models, the 
covariance function is a tool for describing the dependence structure of the 
time series and we can recall that the sequence given by Q is periodi- 
cally correlated, more precisely the covariance function Cov{X n ,X n+ k) is 
T— periodic in n for every k (see As the coefficients in Q are pe- 

riodic, it is obvious that the class of PARMA models is an extension of the 
class of commonly used ARMA models. Due to their interesting properties, 
PARMA systems have received much attention in the literature and turned 
out to be an alternative to the conventional stationary time series as they 
allow for modelling many phenomena in various areas, e.g., in hydrology 
( |H ) , meteorology ( [3] ) , economics ( [HI Ej ) and electrical engineering (0 ) . 

The assumption of normality for the observations seems not to be rea- 
sonable in the number of applications, such as signal processing, telecom- 
munications, finance, physics and chemistry, and heavy-tailed distributions 
seem to be more appropriate, see e.g. ;9_. An important class of distribu- 
tions in this context is the class of a-stable (stable) distributions because 
it is flexible for data modelling and includes the Gaussian distribution as a 
special case. The importance of this class of distributions is strongly sup- 
ported by the limit theorems which indicate that the stable distribution 
is the only possible limiting distribution for the normed sum of indepen- 
dent and identically distributed random variables. Stable random variables 
have found many practical applications, for instance in finance ( J9.J, physics 
(HQ|), electrical engineering (|llj). 

PARMA models with symmetric stable innovations combine the advan- 
tages of classical PARMA models and stable distributions - they offer an 
alternative for modelling periodic time series with heavy tails. However, 
in this case the covariance function is not defined and thus other measures 
of dependence have to be used. The most popular are the covariation and 
codifference presented in j^J ^3 HH • 

In this paper we consider a special case of stable PARMA models, i.e. 
PARMA(1,1) systems with symmetric a-stable innovations. In this case we 
rewrite the equation Q in a simple way, i.e.: 

A n — 6 n A n _i = a n ^ n , (2) 

where n £ Z and the coefficients {b n } and {a n } are nonzero periodic se- 
quences with the same period T while the innovations are independent 
symmetric a-stable (SaS for short) random variables given by the following 
characteristic function: 

Eexp(M£n) = exp(-a a \6\ a ), < a < 2, (3) 

where a denotes the scale parameter. Let us define P = 61&2 • • • and 
B% = Ylj =r bj, with the convention B^ = 1 if r > s. 
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As the covariance function is not denned for stable random vectors, in 
Section |2]we present two other measures of dependence that can be used for 
symmetric stable time series - the covariation and the codiffrence. In Section 
|3]we discuss the necessary conditions for existence of the bounded solution 
of PARMA(1,1) systems for 1 < a < 2 and we note that results obtained 
in 3 for PARMA systems with Gaussian innovations can be extended to 
the case of stable innovations. The covariation and the codifference for 
PARMA(1,1) models with stable innovations are studied in Section |I] and 
the asymptotic relation between these two measures of dependence for the 
considered models is examined there. We find it interesting to illustrate 
theoretical results and thus in Section[2]we give an example of PARMA (1,1) 
systems with SaS innovations and illustrate the periodicity of the considered 
measures of dependence and the asymptotic relation between them. 

2. Measures of dependence for stable time series 

Let X and Y be jointly SaS and let T be the spectral measure of the 
random vector (X,Y) (see for instance 1121). If a < 2 then the covariance 
is not defined and thus other measures of dependence have to be used. The 
most popular measures are: the covariation CV(X, Y) of X on Y defined 
in the following way: 

CV(X,Y)= f sis^ Q - 1> r(ds), Ka<2, (4) 
Js 2 

where s = (si,S2) an d the signed power z <p> is given by z <p> = \z\ p_1 z, 
and the codifference CD(X, Y) of X on Y defined for < a < 2: 

CD(X,Y) = In E exp{i(X -Y)} -In Eexp{iX} -In Eexpi-iY}. (5) 

Properties of the considered measures of dependence one can find in 
|12j . Let us only mention here that, in contrast to the codifference, the 
covariation is not symmetric in its arguments. Moreover, when a = 2 both 
measures reduce to the covariance, namely 

Cov(X, Y) = 2CV(X, Y) = CD(X, Y). (6) 

The covariation induces a norm on the linear space of jointly SaS ran- 
dom variables S a and this norm is equal to the scale parameter, see |12j . 
Hence throughout this paper the norm (so-called covariation norm) ||X|| a 
is defined by ||A"|| Q = (CV(X, A)) 1//a , for a SaS random variable X and 
a > 1. The sequence {X n } n< =z, is bounded in a space S a with norm \ \.\\ a if 
su Pnez ll-^nlla < 00 • Moreover, in this paper we write X = Y in S a if and 
only if \\X-Y\\ a = 0. 
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If it is possible to transform the sequence {X n } to the moving average 
representation X n = Y^jL-co c j( n )Cn-j , where the innovations are in- 
dependent SaS random variables with parameters a and 1 < a < 2, then 
both the covariation and the codifference can be expressed in terms of the 
coefficients Cj(n) (see [T5]): 

oo 

CV(X n ,X m ) = a a c i (n)c m _ n+i (m) <Q - 1> , 

j=-oo 



oo 

CD{X n ,X rn ) =a a (\ c i( n T + \c m -n +J (m)\ a - \ Cj {n) - c m . n+j (m)\ a ) . 

j=-oo 



3. Bounded solution of stable PARMA(1,1) system 

In this section we consider PARMA(1,1) system given by © with the 
SaS innovations for 1 < a < 2 and we investigate when the bounded solution 
exists. 

Let us assume that \P\ < 1. In this case we show that the considered 
PARMA(1,1) system has a bounded solution given by the formula: 



X n ^ ] B n _ s _j_ iCl n — s£,n—s- 



(7) 



s=0 



Provided that every s E Z can be represented as s = NT + j for some 
N = 0, 1, . . . and j = 0, 1, . . . , T — 1, we have 



I y \\ a 



a a ^2 \Bn_ s+1 a n - s \ 
s=0 



oo T-l 

X! X! \ B n-NT-j+l a n-NT-j 
N=0 j=0 



Now it sufficies to notice that by periodicity of coefficients a n _NT-j = o-n-j 

oo 

■\ r>>> -i (i,.,t v r> A a — 1/(1 — \P\ a ) Thus 



and B£_ NT 



= P N B%_ j+1 and that £ \P\ 

J N=0 



\X ri 



P 



T-l 

El* 



< ^ rrn - < oo, 

- 1 _ pa 



where is a real constant, -fT = max. 



=1,...,T 



-j+l u s-J 



}. This 

implies that sup ng ^ ||X n ||" < oo and hence {X n } given by (J7J) is bounded. 
Moreover, it is easy to check that {X n } given by (J7J) satisfies equation ©. 
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To prove the converse, let us note that iterating the equation (J2J) yields: 

fe-i 

X n = B n _ k+ iX n ^k + J]] B n _ s+ ia n - s ^ n ^ s . 

s=0 

For each n € Z and k = NT + j by periodicity of the coefficients we have 
B™_ k+1 = P B™_j +1 . Therefore, if \P\ < 1 and {X n } is a bounded solution 
of Q then 

fc-i 

lim ||X„ — \ i3™_ s+1 a„_ s ^ n _ s || a = lim = 0. 

K— >00 * fc^OO 

This means that the bounded solution of the system considered in this 
section is given by 

fc— 1 oo 

X n = lim / B™_ s+1 a n sfin— s = / , Bn_ s+l a n ^ s ^ n ^ s . 

s=0 s=0 

In a similar manner, it can be shown, that if \P\ > 1, then the bounded 
solution of the system under study is given by 

oo ^ 

X n = ~^2 -^nT^^n+s- (8) 
s=l n n+l 

It is worth pointing out here that the solution for the PARMA (1,1) 
system with SaS innovations takes the same form of the moving average 
as in the case of Gaussian innovations obtained in |3] and it reduces to 
well-known formula for ARMA models in case of constant coefficients. 



4. Dependence structure of stable PARMA(1,1) models 

Let us consider PARMA (1,1) system given by (J2J) with SaS innovations 
for 1 < a < 2. Moreover, we will restrict our attention to the case \P\ < 1 
because this case is more important for applications - as shown in Section 
131 the considered system has a bounded solution {X n } in the linear space 
of jointly SaS random variables with norm ||.|| a given by the causal moving 
average representation (JJJ). 

In order to investigate the dependence structure of stable PARMA (1,1) 
models we will first rewrite X n as X n = J2s=-oo c s( n )£n-si where 
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and then using results presented in Section |21 we will find formulas for the 
covariation and the codifference. We will also study periodicity of these 
measures and their asymptotic relation. 

The covariation. If n > m, then for 1 < a < 2 we have 



OO 

CV(X n , X m ) = a a ^2 ^n-j+i a n-j (^B™_j +1 a n _j 



<a-l> 



j=n—m 



It is easy to notice that z ■ z <a 1;> = \z\ a and B™_j +1 = B^ +l B™_j +1 . 
Therefore, for s = j — n + m we obtain 



CV(X n , X m ) = a a B^ n+l ^2 \B, 



m-s+l a m- 



As every s 6 Z can be represented as s = NT + j for some N = 0, 1, . . . 
and j = 0, 1, . . . , T — 1, we have 



oo T-l 

CV(X n ,X m ) = a a B™ l+1 ^ ^2 \ B m-NT-j+l a m-NT-j 

N=0 j=0 

Now it suffices to notice that by periodicity of coefficients a m -NT-j = flm-j 

oo 

and = P N BZ-i+i and that £ 1^1^" = 1/(1 - I^D- Th us 

7V=0 



B n 



T-l 



CV(X n ,X rn ) - a a - _ ,T jp! a l^m-j+l 



<"m—j 



j=0 



(10) 



If n < m, then the covariation is given by 

oo 

CV(X n ,X m ) = a a ^ B™_j +1 a n -j (b™_ 

j=0 



j+l a n~j 



<a-l> 



In this case - +1 = B™_^^l B™ + i which results in formula 



CV(X n , X n 



a 



Dm 

n n+l j=0 



The simple calculation similar like in the previous case leads us to the result 



CV(X n , X v 



a 



^+1(1-1^ ; „ 



T-l 



id 
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As the sequences {a n } and {b n } are periodic in n with period T, the covari- 
ation is periodic in n and m with the same period, indeed CV(X n , X m ) = 

CV(X n+ T, X m+ T)- 

The codifference. For 1 < a < 2 and n > m we have to calculate 



E 



+ 



R m « 
D n-j+l a n-j 



j=n—m 



Observe that there are a n -j and B™_j +1 (as B™_j +1 = B^_j +l B^ +l ) in 
each part of the above formula. Therefore we can write 

oo 

CD(X n , X m ) = a a (l + |£?™ +1 | Q — |1 — -Bm+iD E Wn-j+l a n 
that can be transformed to 



3\ ' 
J=n— m 



CD(X n , X m ) — a a (1 + |-B^ +1 | Q — |1 — -B^ +1 | a ) ^ |-B™_ s+1 a m _<j| a . 

s=0 

And now it is sufficient to notice that the sum J2^=o |-Bm-s+i a m-s| a nas 
been already calculated for the covariation. So we obtain 

CD(X n ,X m ) = *<* +l m+1 '_, ' m+1 ' E l^+ia m -,r- (12) 

11 j=o 

It is not necessary to calculate the codifference for n < m as this mea- 
sure is symmetric in its arguments, i.e. for every n, m £ Z we have 
CD(X n , X m ) = CD(X m , X n ). By the assumption, the coefficients {a n } 
and {b n } are periodic in re with period T. Thus it is not difficult to notice 
that CD(X n , X m ) = CD(X n+ T, X m+ T), which means that the codifference 
is periodic in re and m with the period T. 

Asymptotic relation between CV and CD. Using formulas (|TT))). 
(fTTj) and (H2J) and two simple facts that hold forl<a<2,0<|P|<l 
and any real constant a / 0: 

1 + \aP m \ a - II -aP m \ a 
lim = a, 

aP m (1 + \aP m \ a - II - aP m \ a ) 
lim — i ' J — = 0, 

m->oo \aP m \ 

it can be proved that for the considered PARMA (1,1) systems with SaS 
innovations the following relations hold for each n € Z and 1 < a < 2: 

CD(X n , A n _£.) CD(X n+ k, X n ) 
urn — — = lim — — = a, (13) 

fe^oo CV(X n , A n _fc) fc^oo c;U(X n+ fc, A n ) 
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Fie. 1. 



CD(X n , X n+ k) 

k^oo CV(X n ,X n+ k) 



0. 



(14) 



The interesting point is that, because of asymmetry of the covariance, 
we obtained quite different asymptotic results. Moreover, (|T5)l extends the 
results obtained in ^3] f° r ARMA models and it reduces to © for a = 2. 



5. Example 

In order to illustrate our theoretical results let us consider PARMA (1,1) 
model with SaS innovations with a = 1, where the coefficients are given by 



0.5 

1.6, 

0.4, 



if n 
if n 
if n 



1,4,7,... 
2,5,8,... 
3,6,9,... 



1 if n = 1,4,7,..., 

2, if n = 2,5,8,..., 

0.003, if n = 3,6,9,.... 



It is clear that the coefficients are periodic with T = 3 and in this case 
P = 0.32. Therefore we are allowed to use formulas obtained in Sections El 
and We first want to demonstrate how the parameter a influences the 
behaviour of the time series, so we plot 1000 realizations of the considered 
model for a = 2, a = 1.7 and a = 1.4, see Figure ^ It is easy to notice 
that the smaller a we take, the greater values of the time series can appear 
(property of heavy-tailed distributions). Next, we want to show the depen- 
dence structure of the considered model, especially periodicity of measures 
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of dependence. In order to do this we plot the codifference CD(X n , X n+ ^) 
and the covariation CV(X n , X n+ fc) for a = 1.7 and a = 1.4 in case of k = 5, 
see Figure |2 Although the behaviour of the measures of dependence de- 
pends on the parameter a, one can observe that both measures are periodic 
with the same period T = 3. 

Finally, let us illustrate the asymptotic relation between the covariation 
and the codifference that is studied in Section 0J Figure contains plots of 

J-l-io fnnrtinnc CD(X n+k ,X n ) CD{X n ,X n _ k ) CD(X n ,X n+k ) , CD(X n _ k ,X n ) 

me iuncuons aCV{Xn+k:Xn) , aC v(x n ,x n _ k )> aCV(x n ,x n+k ) ana aCV(x n _ k ,x n ) 
for k = 0, 1, . . . ,40, n = 50 and a = 1.7 and a = 1.4. According to the 
theoretical results, the first two quotients tend to 1 and the next two tend 
to as /c increases. 
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1 The realizations of PARMA (1.1) model with SaS innovations for a = 2 (top panel), a = 1.7 (r 
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2 The codifference CD(X„. X„ + u) (top panel) and the covariation CV(X„ . X„ + i.) (bottom panei 

3 The plots of the functions ^cvt^ + +K^ ) ^ e ^ r8 ^ J P ane ^)- ZU vfx'^x ~ k j ] ^' ne secon d panel). 



